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An image scanner and an optical character recognition 
system using said image scanner 

Detailed description of the Invention 

5 

Field of the Invention 

This invention is broadly concerned with an image scanner and 
an optical character recognition system using said image scanner, 
10 and more particularly with an image scanner and a character 
recognition system using said scanner which can recognize image 
characters of any region of a document by optically scanning and 
can input said character information as character code data to 
an application software loaded in a personal computer. 



In this description, the term "document" means printed matter 
like book, magazine, newspaper, brochure, visiting card and etc. . 
And the term "character recognition" used in this description means 
not only recognition of usual character like "kana", "katakana", 
20 "kanji" and "alphanumeric" but also recognition of any symbol code 
image like barcode which can be recognized by a computer and can 
be converted to character data. 

The prior art of the invention 
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In any conventional character recognition apparatus of printed 
matter (it will be called document hereafter) using a personal 
computer and flat bed or sheet feed scanner (it will be simply 
called a scanner hereafter) , the following operations are needed 
5 to recognize printed characters . 

(Operation 1) ••■ Scanning document 

First , a document is set to a scanner and the document is scanned. 

10 

(Operation 2) ■•• Character recognition 

The image picture of a whole document sent from said scanner is 
developed and displayed on a CRT display of a personal computer 

15 by character recognition software. After designating by a mouse 
the region where characters are intended to be recognized (this 
region will be called "intended region" hereafter) on a character 
recognition software, the image picture data of the "intended 
region" are converted to text data (character code data) by using 

20 character recognition software and are displayed again on said 
CRT display. 

(Operation 3) ■•■ Correction 



25 



The recognition result by said character recognition software 
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is corrected with key board by comparing the image picture data 
of said document displayed on said character recognition software 
with text data which are recognized result . 

5 (Operation 4) ■■• Copying or pasting of said corrected text data 
to an application software. 

In the next step, the corrected text data are copied by using 
a mouse and pasted to application software such as word processor 
10 or spreadsheet. 

Repetition of operation. 

When more than one document are needed to be recognized, said 
15 operation 1 through 4 should be repeated. When more than one 
"intended region" in a document are needed to be recognized, said 
operation 2 through 4 should be repeated. 

In said conventional character recognition system, parts to be 
20 utilized are needed to be cut or copied from a character recognition 
software and pasted to application software such as word processor 
or spreadsheet in which the text data, converted character codes, 
are utilized. In other words, with said conventional technology, 
the character code converted from image data cannot be utilized 
25 simultaneously at a necessary place of application software such 
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as word processor or spreadsheet when they are working. 

To solve those problem mentioned above, there is an example of 
prior art found in the disclosure of Japanese Non-examined Patent 
5 Publication No. 7-28801, in which character recognition results 
of needed part of image data can be utilized directly by use of 
other application software. That is to say, in said prior art, 
image data including characters are displayed and a designated 
part of said displayed to character code and said character code 
10 are transmitted to application software for document editing or 
data processing. 

The problem to be solved by the present invention 

15 Document sizes for character recognition used by scanners on the 
market are usually type A4 form (occasionally type A3) and they 
are scanned one by one and one page of the document is scanned 
from end to end. 
However, actual document to be scanned varies in size from a 

20 visiting card size or a book size to a newspaper size. Besides, 
in many cases , the characters to be scanned and recognized are 
not all the character of the document but a portion of the document 
or the characters to be scanned are scattered around the document. 
In a prior method of character recognition, an example of which 

25 is disclosed in Japanese Non- examined Patent Publication 
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No. 7-28801, firstly image data including characters are displayed 
on a CRT display monitor of a computer. 

Secondly, the portion to be cut from said displayed image data 
needs to be designated and after characters in the cut image data 
5 are recognized and converted to character code data, they need 
to be transmitted to application software. 

Accordingly, if characters to be inputted scatter around 
document, with said conventional character recognition system, 

10 it is impossible to scan only necessary portion of said characters 
separately from other part of characters which is unnecessary to 
be inputted. In other words, with conventional character 
recognition system, whole document including unnecessary part of 
characters is scanned and clearly said conventional system is 

15 inefficient. 

Besides, said conventional character recognition system can not 
be used in a way that only necessary part of document is scanned 
fittingly, recognized and the recognized results are transmitted 
to application software like word processor while we are reading 

20 the document . 

Besides, in the prior art, after image data are taken into a 
character recognition software, they are displayed on a CRT display 
monitor and portions to be recognized are designated by a pointing 
25 device like mouse, then direct input of characters to application 
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software is made possible. Accordingly, with the prior art we need 
too many operations to make direct input of preferred characters 
to application software . 
The other problem of the prior art is that we cannot check the 
5 results of converted character code data before they are taken 
into character recognition software and accordingly at hand, we 
can not confirm, correct or change the converted result of image 
data on the spot . 

10 The present invention is aiming to solve said problem of the prior 
art and provides a scanner and an optical character recognition 
system using said scanner in which only "intended region" of 
document can be scanned and characters of said region can be 
recognized at background of application software and the 

15 recognition results can be inputted directly to said application 
software . 

The method to solve said problem 

20 To realize said object, the present: invention provides a method 
that can decide and confirm portion of characters to be taken on 
a document and can recognize characters in the background of 
application software and can input the recognition results di- 
rectly to said application software. 
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The image scanner of the present invention comprises; an image 
sensor which retrieves character information on a document as image 
information by scanning optically characters on said document, 
an output part which outputs the image information gotten by 
5 scanning characters with said image sensor, an input part which 
inputs the character recognition results of image information 
outputted by said output part , display part which displays the 
character recognition results inputted by said input part. Said 
image scanner is movable on a document so as to designate at will 
10 the needed recognition region from the character information of 
said document . 

And the conversion results of character image gotten by scanning 
characters on said document can be confirmed at hand by displaying 
the character recognition results on said display part. 

15 

The optical character recognition system of the present 
invention consists of an image scanner and a personal computer. 
Said image scanner comprises ; an image sensor which scans optically 
characters on a document and retrieves character information on 

20 said document as image information, an output part which outputs 
the image information gotten by scanning characters on a document 
with said image sensor to a personal computer, an input part which 
inputs, from said personal computer, the character recognition 
results of image information outputted by said output part, a 

25 display part which displays said character recognition results 



8 



inputted by said input part, and an operating part which operates 
whether the said character recognition results should be fixed 
or not. 

5 The image scanner of the present invention is movable over a 
document so as to designate willingly the region to be recognized 
among character information on the document. 

And conversion results of character information on the document 
can be confirmed at hand by looking at the character recognition 

10 results of designated region of said document displayed in said 
display part and after fixing the conversion results by operating 
said operating part , the fixing signal is transmitted to a computer. 
Said computer should be loaded with at least one application 
software and a character recognition software which recognize 

15 image information output ted by said output part of said image 
scanner. And when image information scanned by said image sensor 
is inputted to said computer, the character recognition results 
by said character recognition software will be transmitted to said 
image scanner. When the signal of fixing conversion result is 

20 transmitted from said image scanner to said computer, the fixed 
character data will be inputted to the designated position of said 
application software. 

Hereafter, the method of data input of the present invention, 
25 that is, the sequence of process of data input in application 
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software such as word processor, spread sheet, data base software 
etc. is described. 

When an image scanner movable over a document scans characters 
on a document so as to designate regions willingly to be recognized 
5 among character information of said document, image data gotten 
by scanning will be transmitted to a personal computer. After said 
personal computer retrieves the image data, character recognition 
software, working at background of application software which deal 
with data input, will recognize said image data as character and 
10 corresponding character code data will be transmitted in bit map 
format to said image scanner. 

When said image scanner receives the character code data, 
characters are displayed on a display part of said image scanner. 
15 When said characters displayed are confirmed as those that are 
intended to be scanned, a signal notifying completion of correct 
scanning will be sent to said personal computer. 

When said personal computer receives said signal notifying 
completion of correct scan, said chajracter code data are inputted 
20 to application software. 

Brief Description of the Drawings 

Fig. 1 

25 Function block diagram showing embodiment of an optical 
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character recognition system of the present invention. 
Fig. 2 

Schematic diagram of the optical character recognition system 
5 shown in Fig.l. 

Fig. 3 

Top plan view showing the structure of the scanner mouse shown 
in Fig.l. 

10 

Fig. 4 

Left side view showing the structure of the scanner mouse shown 
in Fig.l. 

15 Fig. 5 

Sequence diagram showing the flow of process of the optical 
recognition system shown in Fig.l. 

Fig. 6 

20 Block diagram showing another embodiment of the present 
invention in which text data of character recognition are inputted 
directly to an application software. 

Fig. 7 

25 Perspective view of another embodiment of image scanner of the 



11 



present invention. 

Preferred embodiment of the present; invention 

5 Referring to the attached drawings , the embodiment of an image 
scanner and an optical scanning system using said image scanner 
according to the present invention is described hereinafter. 

Referring to Fig. 2, there is shown a schematic diagram of the 
10 preferred embodiment of an optical character recognition system 
according to the present invention in which an image scanner takes 
the form of a scanner mouse. 

In Fig. 2, the personal computer 10 is a conventional computer 
running with an operating system such as Windows 98 of Microsoft 
15 which can deal with Universal Serial Bus (it will be called USB 
hereafter), that is, a high speed bi-directional communication 
bus . 

The personal computer 10 can run with application software such 
20 as word processor, spread sheet, database software etc. and, 
besides , it run with a character recognition software at background 
of said application software. 

In other words , while a character recognition software runs in 
the personal computer 10, the operator of the computer cannot see 
25 the run of said character recognition software but see the run 
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of said application software only and the characters recognized 
with said character recognition software are inputted to the 
application software as if they are inputted with a key board. 

5 The personal computer 10 is connected with CRT display or 
LCD ( Liquid Crystal Display ) display and is connected with key board 
Besides, the personal computer 10 has USB terminal and a scanner 
mouse 20 is connected to said USB terminal of the computer through 
USB cable 50. Thus, by connecting said scanner mouse 20 through 
10 USB to the personal computer, it is possible to communicate 
bi-directionally between said scanner mouse and the computer and 
the computer 10 can supply the scanner mouse 20 with power. 

The scanner mouse 20 has united two parts which have different 
15 function. The one function is a mouse function which acts as a 
pointing device of the personal computer 10 and the other is a 
scanner function which scans document optically and outputs image 
data. The scanner mouse 20 has an image sensor in its bottom to 
scan document optically and it can move over any place on a 
20 document. 

Accordingly, by moving the scanner mouse 20 to an "intended 
region" where we want to carry out character recognition, we can 
scan necessary part of characters of a document. 

25 The scanner mouse 20 transmits the scanned image data of "intended 
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region" of a document to the personal computer 10 through USB cable 
50. When the personal computer 10 receives the image data, the 
character recognition software will recognize the image data and 
the character code, recognition results will be transmitted to 
5 the mouse 20 through the USB cable 50. When the scanner mouse 
receives said character code, the corresponding characters will 
be displayed on the LCD 26. 

Thus, because the character recognition results of scanned 
10 region are shown at almost real time on the LCD 26, the recognition 
results can be confirmed as soon as scanning is done. Accordingly, 
while scanning is being done, the position (the beginning point 
or finishing point of scanning) of "intended region" can be 
adjusted. Moreover, the position of the "intended region" can be 
15 changed if necessary and set point (threshold for binary ) can 
be adjusted adequately while image data are being retrieved. 

In other words, in this embodiment of the present invention, 
taking advantage of higher speed character recognition technology 

20 owing to improved performance of personal computer and taking 
advantage of high speed data transmission of USB, the beginning 
and finishing point of character recognition on a document can 
be checked with the display part 26 by moving slightly the scanner, 
when "intended region" is designated. Accordingly, it is possible 

25 to designate again "intended region" at this stage if starting 
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and/or finishing point of scanning is not adequate. And when a 
voice synthesis software is loaded in the personal computer 10, 
it is possible to know the recognition results by out putting voice 
without checking the display part 26. 

5 

When designation of "intended region" is confirmed and the 
confirmation is fixed by operating the scanner mouse 20, the 
recognition results are inputted directly to a cursor position 
of word processor software or spread sheet software which is 

10 running on the personal computer 10. At this moment, in the 
embodiment of the present invention, the original image data of 
the character recognition results which were sent to said 
application software are shown on the personal computer 10 in order 
to get easy way of correcting possible wrong recognition on said 

15 application software. Accordingly, even if some wrong portion is 
found in the recognition results, the wrong recognized portion 
can be easily corrected on said application software with a key 
board by referring to said image delta. 

20 When a voice recognition software such as described in the 
disclosure of Japanese Non-examined Patent Publication No. 7- 
83353 is loaded so as to amend wrong recognized portion on 
application software with voice, even inexperienced users of the 
computer 10 can amend easily wrong recognized portion. 
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In Fig.l, there is shown a function block diagram of the personal 
computer 10 and the scanner mouse 20 which were described in Fig. 2 . 
Referring to Fig.l, the scanner mouse 20 comprises a mouse and 
image sensor circuit 22, interface circuit 24, a LCD 26 and USB 
5 micro controller 28. In the embodiment of the present invention, 
the scanner mouse 20 can store said scanned image data, but usually 
the scanner mouse 20 is connected with a computer and it outputs 
scanned image data with high speed at real time to the personal 
computer 10 without storing said image data. 

10 

The mouse and image sensor circuit 22 comprises a mouse which 
works as pointing device of a personal computer and an image sensor 
which recognizes picture on a document as image data. The mouse 
and image sensor circuit 22 has also a position sensor circuit 

15 which utilizes a position signal of the mouse as position signal 
of the scanner. The mouse and image sensor circuit 22 is connected 
with the interface circuit 24 and position information detected 
by the mouse and image data retrieved by image sensor are outputted 
to the interface circuit 24 as serial data. The mouse and image 

20 sensor circuit 22 carries out also transmitting control signal 
to the interface circuit 24 and receiving control signal from the 
interface circuit 24. 

The circuit 24 is a interface circuit between the mouse and image 
25 sensor circuit 22 , LCD 26 and USB micro controller 28 . The interface 
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circuit 24 transmits position information detected by a mouse to 
the USB micro controller 28 at real time and when the interface 
circuit 24 receives signals of beginning and finishing for scanning 
and signal of fixing, it will transmit those signals to the mouse 
5 and image sensor circuit 22 . When the interface circuit 24 receives 
control data which display characters on the LCD 26 through the 
USB micro controller 28, it will output the control data (FCC) 
to the LCD 26. With these control data, corresponding characters 
will be shown on the LCD 26. 

10 

USB micro controller 28 is a controller circuit which comprises 
controller part controlling the scanner mouse 20 on the whole and 
USB controller part to transmit and receive data through USB. The 
USB micro controller 28 is connected with a USB driver of the 
15 personal computer 10 through the USB cable 50 and it transmits 
image data retrieved by the image sensor to the personal computer 
10. When the USB micro controller 28 receives character code data 
from the personal computer 10, it will output control data to the 
interface circuit 24 to display characters on the LCD 26. 

20 

The personal computer 10 comprises USB driver 12 of Kernel Layer 
which is controlled at OS (Operating System) level and user 
interface 14 of User Layer which is controlled at application 
software level. In the interface 14 of the referring figure, there 
25 is shown a flow of character recognition process of image data. 



17 



In the user interface 14 of the referring figure, first, image 
data received through the USB driveir from the scanner mouse 20 
are retrieved (140) and secondly they are converted to picture 
data such as bit map (BMP) etc. (142) and finally Japanese Character 
5 recognition is processed (144). 

In the process (144) , image data received from the scanner mouse 
20 are converted successively to character code data of Japanese 
Character and stored in the file (146). The character code data 

10 stored in the file are processed as LCD transmission data (148) 
at almost real time in bit map format and they are transmitted 
to the scanner mouse 20 through the USB driver 12. As a result, 
image data scanned by the scanner mouse 20 are converted to 
character data at real time by the personal computer 10 and the 

15 conversion results of scanning are shown on the LCD 26 at almost 
the same time that scanning is being done. 

Fig. 3 and Fig. 4 shows top plan view and side elevation view of 
the scanner mouse 2 0 respectively which is shown in Fig . 1 and Fig . 2 . 

20 As shown in the figure, in the scanner mouse 20, there are arranged 
a scanner 30 having inside an image sensor, a roller 32, a mouse 
ball 34, and a control circuit 36 controlling the whole scanner 
mouse 20. The scanner 30, the roller 32 and the ball 34 in Fig. 3 
correspond to the mouse and image sensor circuit 22 . And the control 

25 circuit 36 in Fig. 3 corresponds to the interface circuit 24 and 
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the USB micro controller 28. 

The scanner 30 is a contact type image picture sensor and a light 
source is joined to the image sensor within the scanner 30. The 
scanner 30 has a super sensitivity image sensor higher than 400dpi 
5 so as to recognize complicated Kanji letters. 

The scanner mouse 20 has the LCD 26 at the upper side of its top 
surface and 2 or 3 mouse buttons 44 are arranged also on the top 
surface of the scanner mouse 20. The left button 40 is to start 
10 scanning and the right button 42 is to fix characters displayed 
on the LCD 26. On both of the left and right sides of the surface 
of the scanner mouse 20, the indications 46a, 46b are printed to 
indicate scanning area. With these indications on the scanner mouse 
20, it will be easy to adjust a sccinning place on a document. 

15 

Fig. 4 is a structural view of the scanner mouse 20 showing its 
left side view. 

As shown in Fig. 4, the scanner mouse 20 has gentle slope on its 
front part so as to look more easily at the LCD 26 and has a roundness 
20 in the rear so as to be securely grasped. The roller 32 is arranged 
on slightly upper than the ball 34 in order to prevent an influence 
of the roller 32 on the work of ball 34. 

Though not described particularly, we can select by the personal 
25 computer 10 which language, Japanese or English, would be scanned 
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or which input, character or picture, would be used etc. These 
selection may be adjusted also by a control button arranged in 
the scanner mouse 20 or we may use both of these means, personal 
computer or control button. 
5 Instead of indications 46a, 46b, a window having the width of 
the scanner 30 can be made through which document can be seen from 
the top so as to adjust easily position to scan "intended region" . 

Referring Fig. 3 and Fig. 4, the operation of the scanner mouse 
10 20 is described hereinafter. 

While the scanning button 40 is being pressed down, the scanning 
is being done. When the scanning start button 40 is pressed down, 
the scanner mouse will throw light from a light source (not shown) 
to document surface and the scanner sensor 30 will begin to scan 
15 pictures. 

As the scanner 30 is arranged perpendicularly to document, image 
data are retrieved by moving the scanner mouse 20 in the direction 
of the arrow 100 of Fig. 2. The retrieved image data are outputted 
20 to the control circuit 36 and transmitted to the personal computer 
10 according to USB protocol through the USB cable 50. Also, when 
the control circuit 36 receives character code data from the 
personal computer 10, it will take out corresponding letters from 
a built-in memory and displays them on the LCD 26. 
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At this moment, "lines indicating the beginning and the end" of 
"recognized text" are displayed on the LCD 26. The display of 
characters on the LCD 26 are related with scanning direction of 
the scanner 30. To put it concretely, when the scanner 30 moves 
5 from the left to the right, characters on the LCD, namely, 
characters recognition results will firstly appear on the right 
side of the LCD 26. 

And as recognized characters increase, displayed characters will 
increase with moving from the right end toward the left end. 
10 Accordingly, after the first recognized character is displayed , 
it takes some time for it to disappear. 

That means it is possible to confirm easily scanning position. 
Thus, designation and confirmation of the "intended region" will 
be easily done. In other words we can determine easily the beginning 
15 position and the finishing position of inputting at hand while 
concentrating attention on document . 

After the characters shown on the LCD 26 are confirmed and the 
button 42 for scanning fixing is pressed down, the control circuit 

20 36 will detect pressing down of the button 42 and will notify the 
personal computer 10 through the USB cable 50 that confirming and 
fixing process of character code data has completed. When the 
personal computer 10 receives this notice, the character code data 
will be inputted directly to the application software which is 

25 running. 
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In the description of scanning process hereinbefore, scanning 
is done while the scanning start button 40 is being pressed down, 
however other embodiment such as described hereinafter is possible . 
5 That is to say, once the scanning start button is pressed, the 
scanning mouse 20 becomes scanning mode and when the scanning 
button is pressed again, scanning mode is released. In this case, 
the roller 32 goes down to the position where it touches a document 
with the first press of the scanning start button 40 and the roller 
10 32 will go back to the original position with the second press. 
In substitution for the starting button 40 or the fixing button 
42 mentioned above, we can utilize the mouse button 44 to start 
scanning and to fix characters. 

15 Fig. 5 shows a flow of process sequence in the personal computer 
10 and the scanner mouse 20. In this figure, explanations of the 
process 200, 202, 204, 206 and 210 will be over lapped, so one 
example of the process 208 is given herein in which recognized 
text file of character is outputted to an application software 

20 after image file is recognized in the process 206. 

When character recognized text file is outputted , it is inputted 
to application software of MS-Word type by making use of "Win- 
Exec ( )" which is Windows function. Syntax of the "WinExec ( ) " 
25 is as follows ; 
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UNIT WinExec(LPCSTR IpCmdLine, //address of command line UNIT 
nCmdShow, //window style for application) . 

Here, LPCSTR IpCmdLine stands for a bus name of execution file 
5 of "WinWord (MS -WORD) " application software and by changing this 
portion any application file can be designated. 

In the embodiment of the present invention, text code data which 
are character code data by Japanese character recognition process 

10 are inputted to application software without changing its form. 
In a conventional way of inputting data using key board, operating 
system receives inputted data and makes them code form which are 
suitable for application software, whereas in the embodiment of 
the present invention, as mentioned above, several Windows 

15 functions are used for inputting data. Also, in the embodiment 
of the present invention, instead of a single character, a block 
of characters or a line of characters are inputted at the same 
time to application software with text form. With these input 
process, it is possible to input data to application software with 

20 text form faster than any other method including key board input . 

Incidentally, in said embodiment of the present invention, a bus 
name of execution file must be changed when application software 
is changed and operator needs to know what application software 
25 is used. In Fig. 6, an embodiment improving this point is shown 
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and a flow of processing data in the personal computer 10 is shown. 

The operating system 600 is a basic software which manages and 
controls totally operations of hardware and software. To be 
5 concrete, when the operating system 600 receives image data sent 
from the scanner mouse 20, it outputs said image data to character 
recognition software 610 running in the background. 

Also, the operating system 600 controls system so that scan code 
inputted from the key board 17 are handed to I MM (Input Method 
10 Manager) 630 and converted there to character code and displayed 
on the display monitor 15. 

In the operating system 600, IME (Input Method Editor) 620 is 
called by I MM 630 and converts scan code inputted from the key 
15 board 17 to Japanese language or other Asian language of 2 byte 
system. In case of English, scan code inputted from the key board 
17 is converted to character code by IMM 630. 

Therefore, in Japanese version of Windows 98 , when character code 
20 are inputted to the application software 640, the IMM 630 
intervenes among the operating system 600, the character 
recognition software 610, the Japanese kana kanji conversion 
software IME 620, and the application software 640. 

25 Thus, we can output character code of the text file of the 
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character recognition software 610 directly to application 
software by using I MM 630. In this procedure, WN_ME_RE PORT message 
is utilized for carrying character block or character line all 
at once and WN_CHAR or WN_IME_CHAR message is utilized for carrying 
5 single character separately. Therefore, by using I MM 630, we do 
not need to change execution file for any application software. 
IMM is stored in system folder of Windows with the name of I MM 
or WINNLS. 

10 Although an embodiment of the present invention has been de- 
scribed hereinbefore in a case that an image scanner is applied 
to a scanner mouse, the present invention is not restricted 
particularly to a scanner mouse. 

Fig. 7 shows a perspective view of the other embodiment of an image 

15 scanner for the present invention. The image scanner 70 shown in 
Fig. 7 is a plane type image scanner which can recognize character 
of intended region by putting the scanner over the intended region. 
It should be understood that the function block diagram shown in 
Fig.l can be applied also to the embodiment described herein. 

20 

Fig. 7 (a) shows plan view of the image scanner 70. As shown in 
Fig. 7 (a), the image scanner 70 is a size of a postage card and 
rectangular shaped and has a liquid crystal film display panel 
72 of Japanese language on its top surface which displays 
25 recognition results. There is a sceinning starting button 73 at 
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the lower left of the liquid crystal film display panel of Japanese 
language . 

The contact image sensor 74 has a structure in which a light source 
5 and an image sensor are united and is fixed to slidable portion 
75a, 75b. The slidable portions 75a, 75b are fitted to the rails 
76a, 76b so as to slide. The contact image sensor 74 is fitted 
also to the belt 78 with the fixing part 84 which is stretched 
between the driving pulley 80 and the free pulley 82. Therefore, 
10 when the driving pulley 80 turns clockwise, the contact image 
sensor 74 moves to the direction of the arrow 700a and when the 
driving pulley 80 turns counterclockwise , the contact image sensor 
74 moves to the direction of the arrow 700b. 

15 To be concrete, when the button 73 is pressed down, the contact 
image sensor 74 located at the lower left begins to move to the 
direction of arrow 700a by the clockwise turning of the driving 
pulley 80 and begins to scan a draft put just under the scanner. 
The moving distance of the image sensor 7 4 is digitized by an 

20 encoder (not shown) placed at the side of the sensor. Scanning 
to the vertical direction is done by electrical signal within the 
sensor. Both of the vertical and horizontal digitized signals are 
transmitted to the image sensor circuit 20 (refer Fig.l). 

25 The image scanner 70 of the present embodiment is also connected 
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to the personal computer 10 through USB cable and the following 
process is the same as those of the scanner mouse 20 practically. 
In case of the scanner mouse 20 , a scanner is moved over the scanning 
range of a document by hand, however in case of the image scanner 
5 70, the scanner is put on a document and the contact image sensor 
74 moves to scan. Accordingly, the image scanner 70 is able to 
scan "intended region" stably. 

The embodiment of the present invention has been described in 
10 case of a system using Windows 98 with which the present invention 
is applied favorably. However, it should be understood that 
operating system applicable to the present invention is not 
restricted to Windows 98 and the concept of the present invention 
can be applicable to other operating system such as Windows CE, 
15 Macintosh OS and etc. . 

The effect of the invention 

As set forth above, by applying the present invention, it is 
20 possible to make character recognition of necessary portion of 
document easily at hand just like using a pen. And by running a 
character recognition software at background of application 
software, character code data of recognized characters can be 
inputted directly to said application software. Therefore, by 
25 applying the present invention, characters in a document while 
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looking can be converted to character code data just as inputting 
characters with keyboard and accordingly labor of character 
inputting work will be saved drastically. 



\ 
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Claims (Amended on October 16, 2000) 

Claim 1 (Revised) 
5 An image scanner that gives and receives information between said 
scanner and a personal computer loaded with character recognition 
software and at least one application software, comprising 

(a) an image sensor taking character information on any intended 
region of document as image information by optically scanning; 

10 and 

(b) an output part which outputs said taken image information 
to a personal computer; and 

(c) an input part which inputs recognition results from said 
personal computer after recognizing said image information with 

15 said character recognition software; and 

(d) a display part which shows said code information; and 

(e) an operating part which fixes said code information; and 
which is characterized by the fact that said code information 

is output ted to said personal computer through said output part 
20 so as to insert said fixed code information into the designated 
cursor position on said application software working presently, 
responding to said operating part. 



Claim 2 (Revised) 
25 The image scanner of the Claim 1, which is characterized by the 
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fact that said scanner has pointing device function of said 
personal computer. 

Claim 3 

5 The image scanner of Claim 2 , which is characterized by the fact 
that this image scanner is a scanner mouse having mouse function 
as said pointing device. 

Claim 4 (Revised) 
10 The image scanner of Claim 3, which is characterized by the fact 
that this image scanner has a sensor circuit that utilizes the 
position signal of said mouse or the position signal of an image 
sensor as a position signal of the scanner. 

15 Claim 5 

The image scanner of Claim 2, which is characterized by the fact 
that this image scanner is connected to said personal computer 
by high-speed bi-directional communication bus. 

20 Claim 6 (Revised) 

The image scanner of Claim 1 , which is characterized by the fact 
that said code information is shown in said display part at real 
time and said code information is able to be changed until said 
fixing operation is done. 
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Claim 7 (Revised) 

In an optical character recognition system composed of a personal 
computer loaded with a character recognition software and at least 
one application software and an image scanner that gives and 
5 receives information between said image scanner and said personal 
computer, 

it is characterized by the fact that said image scanner is 
comprising 

(a) an image sensor part which takes character information of 
10 any intended region on documents by scanning optically as image 

information ; and 

(b) an output part which outputs said image information to said 
personal computer; and 

(c) an input part which inputs recognition results from said 
15 personal computer after recognizing said image information as code 

information by said character recognition software; and 

(d) a display part to display said code information; and 

(e) an operating part to fix said code information; and 
said image scanner sends out said code information to said 

20 personal computer through said output part, responding to said 
fixing operation and 

said personal computer inserts said received code information 
into the designated cursor position on said application software 
running presently. 
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Claim 8 (Revised) 

The optical character recognition system of Claim 7, which is 
characterized by the fact that said at least one application 
software is voice synthesis software and said code information 
5 is outputted by converting into corresponding voice information. 

Claim 9 (Revised) 

The optical character recognition system stated in Claim 7 , which 
is characterized by the fact that said at least one application 
10 software includes voice recognition software and said code 
information is amended responding to the voice instruction for 
amending . 

Claim 10 (Revised) 
15 Being provided with personal computer loaded with a character 

recognition software and at least one application software, and 

an image scanner which gives and receives information between said 

image scanner and said personal computer, 
a method of inputting data from said image scanner to said at 
20 least one application software, which is characterized by the fact 

that said image scanner takes character information on any intended 

region of documents as image information by optically scanning 

and send it to said personal computer, and 
said character recognition software operates at the background 
25 of said at least one application software working presently and 




recognizes said received image information as characters and 
converts them into code information and transfers them to said 
image scanner from said personal computer, and 

said image scanner displays said code information received and 
5 then fixing operation of said code information is done, and 

said image scanner transmits said code information to said 
personal computer responding to said fixing operation, and 

said personal computer inserts said received information into 
the designated cursor position in said at least one application 
10 software working presently. 

Claim 11 (Revised) 

The data input method stated in the Claim 10, which is 
characterized by the fact that at least one application software 
15 is a program software which enables to use said code information 
as 2 byte Asian language in operating system, and said code 
information is inputted through said program (hooking) software 
into said at least one application software working presently. 

20 Claim 12 (Revised) 

The data input method stated in the Claim 10, which is characterized 
by the fact that both said code information and said image 
information are shown in the displaying picture of said personal 
computer, and said code information is amended with referring to 

25 said image information shown. 
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Attorney Docket No, HAG 1 37 



DECLARATION AND POWER OF 
ATTORNEY ORIGINAL PATENT APP LICATION . 



As a below named inventor, I hereby declare that: 



Type of Application 



This declaration is for the following type application: 



X 



Original 
Design 

National Stage of PCT 

Divisional 

Continuation 

Continuation-in-Part (CIP) 



Inventorship Identification 



My residence, post office address and citizenship are as stated below next to 
my name, I believe I am the original, first and sole inventor (if only one name 
is listed below) or an original, first and joint inventor (if plural names are 
listed below) of the subject matter which is claimed and for which a patent is 
sought on the invention entitled; 



AN IMAGE SCANNER AND AN OPTTCAL CTf ARAfiTKR RF.n OGNTTION 
SYSTEM T ISTNCt fiATD TMAfttt SPAM MER 



Specification Identification 



The specification of which: 



is attached hereto. 



was filed on 



as Application Serial No. 



and was amended on 
(inapplicable). 



3L_ was described and claimed in PCT International Application 
No. PCT/JPS9/Q5945 filed on October 27. 1 999 
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Acknowledgement of Review of Papers and Duty of Candor 

I hereby state that I have reviewed and underst and the contents of the above 
identified specification, including the claims, as amended by any 
amendment referred to above. 



I acknowledge the duty to disclose information which is material to the 
examination of this application in accordance with Title 37, Code of Federal 
Regulations, § 1.56, which provides: 



(a) A patent by its very nature is affected with a public 
interest.The public interest is best served, and the most effective 
patent examination occurs when, at the time an application is being 
examined, the Office is aware of and evaluates the teachings of all 
information material to patentability. Each individual associated 
with the filing and prosecution of a patent application has a duty of 
candor and good faith in dealing with the Office, which includes a duty 
to disclose to the Office all information known to that individual to be 
material to patentability as defined in this section. The duty to 
disclose information exists with respect to each pending claim until 
the claim is canceled or withdrawn from consideration or the 
application becomes abandoned. Information material to the 
patentability of a claim that is canceled or withdrawn from 
consideration need not be submitted if the information is not material 
to the patentability of any claim remaining under consideration in the 
application. There is no duty to submit information which is not 
material to the patentability of any existing claim. The duty to 
disclose all information known to be material to patentability is 
deemed to be satisfied if all information known to be material to 
patentability of any claim issued in a patent was cited by the Office or 
submitted to the Office in the manner described by § § 1.97 (b)— (d) 
and 1.98. However, no patent will be granted on an application in 
connection with which fraud on the Office was practiced or attempted 
or the duty of disclosure was violated through bad faith or intentional 
misconduct. The Office encourages applicants to carefully examine; (1) 
prior art cited in search reports of a foreign patent office in a 
counterpart application, and (2) the closest information over which 
individuals associated with the filing or prosecution of a patent 
application believe any pending claim patentably defines, to make 
sure that any material information contained therein is disclosed to 
the Office. 

(b) Under this section, information is material to 
patentability when it is not cumulative to information already of 
record or being made of record in the application, and 
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(1) it establishes, by itself or in combination with other 
information, a prima facie case of unpatentability of a claim; or 

(2) it refutes, or is inconsistent with, a position the 
applicant takes in: 

(i) opposing an argument of unpatentability relied 

on by the Office, or 

(ii) asserting an argument of patentability. A prima 
facie case of unpatentability is established when the information 
compels a conclusion that a claim is unpatentable under the 
preponderance of evidence, burden-of-proof standard, giving each term 
in the claim its broadest reasonable construction consistent with the 
specification, and before any consideration is given to evidence which 
maybe submitted in an attempt to establish a contrary conclusion of 
patentability. 

(c) Individuals associated with the filing or prosecution of a 
patent application within the meaning of this section are: 

(1) each inventor named in the application; 

(2) each attorney or agent who prepares or prosecutes 
the application; and 

(3) every other person who is substantively involved in 
the preparation or prosecution of the application and who is 
associated with the inventor, with the assignee or with anyone to 
whom there is an obligation to assign the application, 

(d) Individuals other than the attorney, agent or inventor may 
comply with this section by disclosing information to the attorney, 
agent, or inventor. 

In compliance with this duty there is attached an information 

disclosure statement, 37 CFR 1.97. 

I do not know and do not believe that the invention was ever known or used 
in the United States of America before my or our invention thereof; I do not 
know and do not believe that the invention was ever patented or described in 
any printed publication in any country before my or our invention thereof or 
more than one year prior to this application; I do not know and do not believe 
that the invention was in public use or on sale in the United States of 
America more than one year prior to this application; and the invention has 
not been patented or made the subject of an inventor's certificate issued 
before the date of this application in any country foreign to the United 
States of America on an application filed by me or my legal representatives 
or assigns more than twelve months prior to this application. 
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Priority Claim 

I hereby claim foreign priority benefits under Title 35, United States Code, 
§ 119 of any foreign appUcation(s) for patent or inventor's certificate or of 
any PCT international application(s) designating at least one country other 
than the United States of America listed below and have also identified 
below any foreign application(s) for patent or inventor's certificate or any 
PCT international applications) designating at least one country other than 
the United States of America filed by me on the same subject matter having 
a filing date before that of the application(s) of which priority is claimed. 

No such applications have been filed. 

X Such applications have been filed as follows. 



Country 


Application 
Number 


Date of Filing 
(Month/Day/Year) 


Priority 
Claimed 


Japan 


308945/1998 


October 29, 1998 




Nfl 


X 













































Power of Attorney 

As a named inventor, I hereby appoint the following attomey(s) and/or 
agent(s) to prosecute this application and transact all business in the 
Patent and Trademark Office connected therewith. 




Edward D. Manzo, 28, 139 



Send correspondence to: Direct telephone calls to: 

■JklwardJD. Mango, Esq. Edward D. Manzo, Esq. 

_CCiOK L ALEjCMcFARRQN. MANZO, (312) 236-8500 

Ic1jmmin(c5l& MEHLER^ LTD . 
_200 West Adams Street 
Suite 2850 _ 

Chicago, Illinois 60606-5234 
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• • • 

Declaration 

I hereby declare that all statements made herein of my own knowledge are true 
and that all statements made on information and belief are believed to be true; 
and further that these statements were made with the knowledge that willful 
false statements and the like so made are punishable by fine or imprisonment, or 
both under Section 1001 of Title 18 of the United States Code and that such 
willful false statements may jeopardize the validity of the application or any 
patent issued thereon. 

/' Full name of solo inventor _Mitsuo NAKA YAMA 

Country of Citizenship Japan . JPK 

Residence and 

Post Office Address „ 4-13-3. Shihaurfl Minahn- b./Nm^ ,1 fl pan 

Inventor's Signature ffli&it&> /?a&AUdJTUU> Date g ft. ZV 
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